Claims 

What is claimed is: 

1 . A method allowing a choice of Least Frequently Used (LFU) or Most 
5 Frequently Used (MFU) cache line replacement, the method comprising the steps of: 

determining new state information for at least two given cache lines of a 
plurality of cache lines in a cache, the new state information based at least in part on prior 
state information for the at least two given cache lines; and 

when an access miss occurs in one of the at least two given lines: 
10 selecting either LFU or MFU replacement criteria; and 

replacing one of the at least two given cache lines based on 
the new state information and the selected replacement criteria. 

2. The method of claim 1, wherein the step of selecting further comprises the 
15 step of selecting either LFU or MFU replacement criteria based on selection information. 

3 . The method of claim 1 , wherein: 

the state information comprises a plurality of line use counters, each line 
use counter corresponding to one of the plurality of cache lines; and 
20 the step of determining new state information further comprises the step of 

incrementing a given line use counter when a cache line corresponding to the given line 
use counter is referenced. 

4. The method of claim 3, where the reference to the cache line 
25 corresponding to the given line use counter is a hit reference. 
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5. The method of claim 3, wherein: 

the plurality of cache lines are assigned to a plurality of congruence 
classes, each congruence class assigned to at least two of the plurality of cache lines, 
whereby at least two of the line use counters corresponds to a congruence class; 
5 the state information further comprises a plurality of congruence class use 

counters; and 

the step of determining new state information further comprises the step of 
incrementing a given one of the plurality of congruence class use counters when a 
congruence class corresponding to the given congruence class use counter is referenced, 
10 wherein each of the plurality of congruence class use counters corresponds to one of the 
congruence classes. 

6. The method of claim 5, wherein the reference to the congruence class 
corresponding to the given congruence class use counter is a hit reference. 

15 

7. The method of claim 5, wherein: 

the plurality of line use counters are also assigned to the plurality of 
congruence classes, one line use counter per cache line assigned to a congruence class; 
and 

20 the step of determining new state information further comprises the step 

of, when one or more of the line use counters corresponding to a given congruence class 
exceeds a maximum line use counter limit, dividing all of the line use counters 
corresponding to the given congruence class by an integer. 

25 8. The method of claim 7, where the integer is a power of 2. 
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9. The method of claim 5, wherein: 

a given congruence class corresponds to a given congruence class use 

counter; and 

the step of determining new state information further comprises the steps 
5 of, when the given congruence class use counter exceeds a maximum congruence class 
use counter limit: 

dividing all of the line use counters corresponding to the 
given congruence class by an integer; and 

resetting the given congruence class use counter. 

10 

1 0. The method of claim 9, where the integer is a power of 2. 

11. The method of claim 5, wherein the cache is an n-way set associative 
cache, whereby there are n cache lines per congruence class. 

15 

12. The method of claim 3, wherein the step of determining new state 
information further comprises the steps of: 

inverting a predetermined number of line use counters; 

selecting, based on the step of selecting either LFU or MFU replacement 
20 criteria, either values of the predetermined number of line use counters or the inverted 
versions of the predetermined number of line use counters, wherein the values of the 
predetermined number of line use counters are selected for an LFU calculation and the 
inverted versions of the predetermined number of line use counters are selected for an 
MFU calculation; and 

25 determining which of the values of the predetermined number of line use 

counters or the inverted versions of the predetermined number of line use counters is 
smallest in value. 
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13. A cache allowing a choice of Least Frequently Used (LFU) or Most 

Frequently Used (MFU) cache line replacement, the cache comprising: 
a plurality of cache lines; 

state information for at least two given cache lines of the plurality of cache 

lines; 

LFU/MFU circuitry adapted: 

to determine new state information for at least two given 
cache lines of a plurality of cache lines in a cache, the new state 
information based at least in part on prior state information for the at least 
two given cache lines; 

when a cache miss occurs in one of the at least two given 

lines: 

to select either LFU or MFU replacement criteria; 

to determine which one of the at least two given cache lines 
should be replaced based on the new state information and the selected 
replacement criteria; and 

replacement circuitry coupled to the LFU/MFU circuitry and to the 
plurality of cache lines, the replacement circuitry adapted to replace the selected given 
cache line. 



14. The cache of claim 13, wherein the LFU/MFU circuitry further comprises 
selection circuitry, and wherein the selection circuitry is adapted to select either the LFU 
or MFU replacement criteria. 

15. The cache of claim 13, wherein: 

the state information comprises a plurality of line use counters, each line 
use counter corresponding to one of the cache lines; 

the LFU/MFU circuitry is further adapted to increment a given line use 
counter when a cache line corresponding to the given line use counter is referenced. 
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16. The cache of claim 15, where the reference to the cache line corresponding 

to the given line use counter is a hit reference. 

5 17. The cache of claim 15, wherein the plurality of cache lines are assigned to 

a plurality of congruence classes, each congruence class assigned to at least two of the 
plurality of cache lines, whereby at least two of the line use counters corresponds to a 
congruence class, the state information further comprising a plurality of congruence class 
use counters, each of the congruence class use counters corresponding to one of the 
10 congruence classes, and wherein the LFU/MFU circuitry is further adapted to increment a 
given congruence class use counter when a congruence class corresponding to the given 
congruence class use counter is referenced. 

18. The cache of claim 17, wherein the reference to the congruence class 
15 corresponding to the given congruence class use counter is a hit reference. 

19. The cache of claim 17, wherein the plurality of line use counters are also 
assigned to the plurality of congruence classes, one line use counter per cache line 
assigned to a congruence class, and wherein the LFU/MFU circuitry is further adapted, 

20 when one or more of the line use counters corresponding to a given congruence class 
exceeds a maximum line use counter limit, to divide all of the line use counters 
corresponding to the given congruence class by an integer. 

20. The cache of claim 19, where the integer is a power of 2. 

25 
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21. The cache of claim 17, wherein a given congruence class corresponds to a 
given congruence class use counter, and wherein the LFU/MFU circuitry is further 
adapted, when the given congruence class use counter exceeds a maximum congruence 
class use counter limit, to divide all of the line use counters corresponding to the given 

5 congruence class by an integer and to reset the given congruence class use counter. 

22. The cache of claim 2 1 , where the integer is a power of 2. 

23. The cache of claim 17, wherein the cache is an n-way set associative 
10 cache, whereby there are n cache lines per congruence class. 

24. The cache of claim 15, wherein the LFU/MFU circuitry further comprises: 
a multiplexer (MUX) coupled to a predetermined number of line use 

counters and to inverted versions of the predetermined number of line use counters, the 
15 MUX adapted to select, as a predetermined number of outputs, either values of the 

predetermined number of line use counters or the inverted versions of the predetermined 

number of line use counters; 

an LFU detector coupled to the predetermined number of outputs of the 

MUX and adapted to determine which of the predetermined number of outputs is smallest 
20 in value, the LFU detector producing one or more LFU outputs, wherein the one or more 

LFU outputs are coupled to the replacement circuitry; and 

selection circuitry coupled to the MUX and adapted to cause the MUX to 

select either the values of the predetermined number of line use counters or the inverted 

versions of the predetermined number of line use counters. 

25 
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25. A cache for replacing Most Frequently Used (MFU) cache lines, the cache 

comprising: 

a plurality of cache lines; 

state information for at least two given cache lines of the plurality of cache 

lines; 

MFU circuitry adapted: 

to produce new state information for the at least two given 
cache lines in response to an access to one of the at least two given cache 
lines; and 

when a cache miss occurs in one of the at least two given 
cache lines to determine, based on the new state information, which of the 
at least two given cache lines is the most frequently used cache line; and 
replacement circuitry coupled to the MFU circuitry and to the plurality of 

cache lines, the replacement circuitry adapted to replace the given cache line determined 

as the most frequently used. 
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